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TITLE OF THE INVENTION 

IMAGE DATA PROCESSING APPARATUS, IMAGE DATA PROCESSING METHOD, AND 

COMPUTER READABLE MEDIUM 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application is related to and claims the benefit of Japanese Application No. 2003- 
142582 filed May 20, 2003 in the Japanese Patent Office, the contents of which are 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0002] The present invention relates to an image data processing apparatus, an image data 
processing method, and an image data processing program that are can be suitably used in, for 
example, encoders or decoders. Particularly, the present invention relates to an image data 
processing apparatus, an image data processing method, and an image data processing 
program that can reduce the processing required to embed a code into image data or decode 
the code. 

2. Description of the Related Art 

[0003] U.S. Patent No. 5,636,292 and Japanese Patent Application Laid-Open No. 2000- 
299779 disclose embedding of separate data (such as a code) into image data or audio data to 
prevent falsifications, prevent an illicit use, and provide additional services. 

[0004] As the technique is applied for a security purpose, conventional methods are 
designed to be able to bear a deformation of original data or a request for a partial use. For 
example, a very complex method (such as a digital watermark) is conventionally employed such 
as a spread disposition of the same data within an image or inputting data in a frequency region 
using a Fast Fourier Transformation (FFT). 

[0005] The digital watermark technique is applied to various additional services. For 
example, U.S. Patent No. 5,841,978 discloses a method of reading a digital watermark 
embedded into a printed material, and displaying a specific web page. 

[0006] In the conventional technique of embedding a digital watermark, it is necessary to 
calculate the FFT. However, it requires a huge number of calculations to be performed to 
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calculate the FFT. 

[0007] It is practically difficult to embed or read data into or from the image data in portable 
information devices (portable telephone, PHS (Personal Handy phone System), PDAs (Personal 
Digital Assistant) and the like because these devices have limited resources such as less 
memory capacity or slower processors. 

[0008] These together with other aspects and advantages which will be subsequently apparent, 
reside in the details of construction and operation as more fully hereinafter described and 
claimed, reference being had to the accompanying drawings forming a part hereof, wherein like 
numerals refer to like parts throughout. 

SUMMARY OF THE INVENTION 

[0009] The present invention has been achieved in order to solve the above problems. It is 
an aspect of the present invention to provide an image data processing apparatus, an image 
data processing method, and a computer readable medium that can reduce the processing 
required to embed a code into image data or decode the code. 

To achieve the above mentioned aspect, the present invention includes an image data 
processing apparatus comprising a dividing unit that divides image data into a plurality of blocks, 
a characteristic amount extracting unit that extracts a characteristic amount from each of the 
blocks, and an encoding unit that embeds a plurality of codes based on a magnitude relation of 
the characteristic amount between each pair of blocks in the blocks. 

Moreover, the present invention includes an image data processing method comprising 
dividing image data into a plurality of blocks, extracting a characteristic amount from each of the 
blocks, and embedding a plurality of codes based on a magnitude relation of the characteristic 
amount between each pair of blocks in the blocks. 

Moreover, the present invention includes a computer-readable medium storing a 
program which, when executed by a computer, causes the computer to perform operations 
comprising dividing image data into a plurality of blocks extracting a characteristic amount from 
each of the blocks, and embedding a plurality of based on a magnitude relation of the 
characteristic amount between each pair of blocks in the blocks. 

[0010] According to the present invention, one code is related to each pair of blocks in a 
plurality of blocks as a result of dividing image data, based on a magnitude relation of 
characteristic amount, and a plurality of codes are embedded into a plurality of blocks. 
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Therefore, the necessity to calculate the FFT is eliminated by the present invention, and the 
processing required to embed the code into the image data is reduced by the present invention. 

Moreover, the present invention includes an image data processing apparatus 
comprising a dividing unit that divides image data into a plurality of blocks, an error-correction- 
coding code generating unit that encodes a code using an error correction coding to generate 
an error-correction-coding code, a characteristic amount extracting unit that extracts a 
characteristic amount from each of the blocks, and an encoding unit that embeds a plurality of 
error-correction-coding codes based on a magnitude relation of the characteristic amount 
between each pair of blocks in the blocks. 

[0011] According to the present invention, as a plurality of error-correction-coding codes are 
embedded into a plurality of blocks, there is an effect that the decoding side can correct an error, 
and reliability is increased. 

[0012] These together with other aspects and advantages which will be subsequently 
apparent, reside in the details of construction and operation as more fully hereinafter described 
and claimed, reference being had to the accompanying drawings forming a part hereof, wherein 
like numerals refer to like parts throughout. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] Fig. 1 is a block diagram of the encoder 100 according to the first embodiment of the 
present invention. 

[0014] Fig. 2 is an example of original image data 10. 

[0015] Fig. 3 is an example of image data 11. 

[0016] Fig. 4 is an example of a code C. 

[0017] Fig. 5 is an example of image coded data 13. 

[0018] Fig. 6 is a flowchart of an operation example 1 . 

[0019] Fig. 7 explains about a density change processing of the encoder 100. 

[0020] Fig. 8 is a flowchart of an operation example 2. 
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[0021] Fig. 9 is a block diagram of the decoder 200 according to the first embodiment. 

[0022] Fig. 10 explains about the majority decision processing by the decoder 200. 

[0023] Fig. 11 is a flowchart of operations performed by the decoder 200. 

[0024] Fig. 12 is a block diagram of an encoder 300 according to the second embodiment. 

[0025] Fig. 13 is a block diagram of a decoder 400 according to the second embodiment. 

[0026] Fig. 14 is a flowchart of operations performed by the decoder 400. 

[0027] Fig. 15 explains about the code determination processing by the decoder 400. 

[0028] Fig. 16 is to explain a third embodiment of the present invention. 

[0029] Fig. 1 7 is a block diagram of an encoder 500 according to a fourth embodiment of the 
present invention. 

[0030] Fig. 18 is a graph that illustrates a relation between the density change quantity and 
the MOS value according to the fourth embodiment. 

[0031] Fig. 19 explains about the image cut-out processing according to the fifth embodiment 
of the present invention. 

[0032] Fig. 20 is a flowchart of a four-corner search processing according to the fifth 
embodiment. 

[0033] Fig. 21 explains about the four-corner search processing according to the fifth 
embodiment. 

[0034] Fig. 22 is a block diagram of a computer as a modification according to the first to the 
fifth embodiments of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0035] An image data processing apparatus, an image data processing method, and an 
image data processing program according to first to fifth embodiments of the present invention 
are explained in detail below with reference to drawings. 
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[0037] An image data processing apparatus according to a first embodiment of the present 
invention relates to an encoder 100 (refer to Fig. 1) that embeds a (binary) code as separate 
data into original image data, and a decoder 200 (refer to Fig. 9) that reads the code from the 
image coded data. 

[0038] Fig. 1 is a block diagram of the encoder 100. The encoder 100 embeds a code C 
(refer to Fig. 4) eight times, for example, into original image data 10, and generates image coded 
data 13 (refer to Fig. 5). 

[0039] Fig. 2 shows an example of original image data 10. As discussed herein below, the 
code C will be embedded in the original image data 10. In the example shown in Fig. 2, the 
original image data 10 is a digital image, but the present invention is not limited to this example. 

[0040] The original image data 10 is generated in a predetermined format and has a size of 
1024 x 1024 pixels. The predetermined format may be JPEG (Joint Photographic Expert 
Group), GIF (Graphics Interchange Format) and the like. The code C (1010110101001010) 
having 16 bits illustrated in Fig. 4, for example, is embedded into the original image data 10. 

[0041] In the encoder 100 shown in Fig. 1, a block dividing section 101 divides the original 
image data 10 into blocks of N rows x M columns (16 x 16, in the drawing) as illustrated in Fig. 3, 
and outputs the resultant data as image data 11 after division. 

[0042] The image data 11 includes 256 (16x16) blocks having blocks B M1 , B r11 B M8 , B r18 , 

Bel Br2i, .... B, 168 , and B r168 . One block is of 64 x 64 pixels. 

[0043] A code of one bit is embedded into a pair of blocks. 

[0044] This pair of blocks includes two blocks in proximity to each other. For example, these 
two blocks are adjacent horizontally or vertically to each other, or they are diagonal to each 
other and touch corner to corner. 

[0045] In this embodiment, the pair of blocks includes two blocks adjacent horizontally to 
each other. 

[0046] Concretely, the blocks B m and B r11 , the blocks B, 12 and B r12 and the blocks B M8 and 
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B r18 (a first row up to this block), the blocks B, 12 i and B r12 i, .... and the blocks B, 128 and B r128 (a 

second row up to this block), .... and the blocks B, 161 and B rl61 and the blocks B, 168 and B r168 

(a 16-th row up to this block), respectively, are the pairs of blocks. 

[0047] In a block represented as B, xy , the suffix I means that the block is on the left in the pair 
of the blocks, suffix x denotes a row (N), and suffix y denotes a column (M). On the other hand, 
in a block represented as B^, the suffix r means that the block is on the right in the pair of the 
blocks, suffix x denotes a row (N), and suffix y denotes a column (M). 

[0048] An average density, a characteristic amount, of the left block B, xy (i.e., average 
gradation of each pixel within the block) is expressed as left-side average density data D,, and 
that of the right block B^y is expressed as right-side average density data D r . 

[0049] When the left-side average density data D, is less than the right-side average density 
data D r as illustrated in the following expression, the pair of blocks express "0" as a code of one 
bit. On the other hand, when the left-side average density data D, is equal to or larger than the 
right-side average density data D r , the pair of blocks express "1" as a code of one bit. 

[0050] D, < D r -> [0] 

[0051] D,>D r ->[1] 

[0052] For example, as shown in Fig. 3, left-side average density data D M8 of block B, 18 is 
"115" and right-side average density data D r18 of B r18 is "125" so that the pair of blocks B, 18 , and 
B r18 express "0" as a code of one bit. 

[0053] Regarding the pair of blocks B, 28 and B^e, left-side average density data D, 28 is "125", 
and right-side average density data is "115". Therefore, the pair of blocks express "1" as a 
code of one bit. 

[0054] In the image data 11, there are eight pairs of blocks in each row (i.e., total 16 blocks), 
and therefore, this data expresses a code of eight blocks. Accordingly, the total rows (16 rows) 
express codes of 128 bits in total. In the first embodiment, the code C (refer to Fig. 4) to be 
embedded into the image data 11 has 16 bits. Therefore, the code C can be embedded into the 
image data 11 by eight (i.e., 128/16) times (refer to Fig. 5). 

[0055] Referring back to Fig. 1, a characteristic amount extracting section 107 includes a 



6 



Attorney Docket No. 1341.1173/GMG 
block extracting section 102, an averaging section 103, a register 1041, and a register 104r. A 
block extracting section 102 sequentially extracts the pair of blocks (the block and the block 
Brx) from the image data 11 (refer to Fig. 3) following a bit shift of the code C. The block 
extracting section 102 sequentially outputs density distributions of the block B, x and the block B^ 
as block density data D. 

[0056] The bit shift of the code C refers to the shifting of a bit pointer (not illustrated) from the 
leftmost bit (1) to the right bit (0) illustrated in Fig. 4 by one bit each time. 

[0057] An averaging section 103 calculates left-side average density data corresponding 
to the block B, x and right-side average density data D r corresponding to the block B^ from the 
block density data D, and sequentially stores the left-side average density data into a register 
104, and the right-side average density data D r into a register 104 r following the bit shift of the 
code C. 

[0058] A comparing section 105 compares the n-th bit of the code C (n = 1, 2, .... 16) with the 
result of a bit decision made from the magnitude relation between the left-side average density 
data D, and the right-side average density data D r stored in the register 104, and the register 
104 r , respectively (bit decision is made as "0" or "1" from the expressions described above). 

[0059] An encoding section 106 embeds the code C into the image data 11 (the original 
image data 10) based on the result of the comparison carried out by the comparing section 105, 
and outputs the code C embedded data, image coded data 13, to the outside of encoder 100. 
Specifically, when the result of the comparison carried out by the comparing section 105 
indicates coincidence, the encoding section 106 maintains the magnitude relation between the 
left-side average density data D, and the right-side average density data D r . On the other hand, 
when the result of the comparison indicates non-coincidence, the encoding section 106 changes 
the left-side average density data D, and the right-side average density data D r (i.e., reverses 
the magnitude relation) so as to obtain the magnitude relation that expresses the bit of the code 
C, generates the image coded data 13 (refer to Fig. 5), and outputs this data. 

[0060] The image coded data 13 illustrated in Fig. 5 corresponds to the image data 11 (refer to 
Fig. 3) and the original image data 10 (refer to Fig. 2), and has areas A, to Aq. The same code C 
(1010110101001010) is embedded by eight times in total into the areas A, to Aq. 

[0061] For example, the area A^ corresponds to the blocks B M1 , B r11 , .... B, 28 . and B^. Other 
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areas A 2 to Aq correspond to the blocks B, 31 , B r31> B M68 , and B r168 . 

[0062] While Fig. 5 illustrates a state that the code C (refer to Fig. 3) is embedded, the actual 
image coded data 13 corresponds to the image data that is substantially the same as the original 
image data 10 (refer to Fig. 2) (i.e., it is substantially impossible to visually discriminate between 
these drawings although a part of the blocks may have changed density). 

[0063] Constituent elements of the encoder 100 are connected to each other via a control 
section (not shown). 

[0064] The operation of the encoder 100 is explained with reference to flowcharts in Fig. 6 
and Fig. 8. Fig. 6 is a flowchart that explains an operation example 1 of the encoder 100. 

[0065] At operation SA1 , the code C is set to the comparing section 105. At operation SA2 f 
the comparing section 105 initializes n to 1 . n denotes a pointer of the bit of the code C. n=1 
corresponds to the leftmost bit ("1") of the code C. 

[0066] At operation SA3, the original image data 10 is input to the block dividing section 101 . 
At operation SA4, the block dividing section 101 divides the original image data 10 into 16x16 
blocks Bm to B r1168 and outputs the result as the image data 11 to the block extracting section 
102. 

[0067] At operation SA5, the block extracting section 102 extracts a pair of blocks 
corresponding to n = 1 (i.e., the block B M1 and the block B r11 ) from the image data 11. Then, the 
block extracting section 102 outputs the density distributions of the block B t11 and the block B r11 
as the block density data D to the averaging section 103. 

[0068] At operation SA6, the averaging section 103 obtains the left-side average density data 
D M1 of the block B M1 and the right-side average density data D r11 of the block B r11 from the block 
density data D by the average processing. 

[0069] At operation SA7, the averaging section 103 provides a control to store the left-side 
average density data D M1 into the register 104, and store the right-side average density data D r11 
into the register 104 r . 

[0070] At operation SA8, the comparing section 105 obtains "1" that is the leftmost bit 
(corresponding to n = 1) of the code C, and a difference between the left-side average density 
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data D m and the right-side average density data D r11 and executes the bit decision based on the 
difference in the densities (i.e., magnitude relation). 

[0071] Concretely, if the left-side average density data D m is equal to or larger than the right- 
side average density data D r11l the comparing section 105 sets "1" as a result of the decision 
made for the pair of blocks based on the above magnitude relation. 

[0072] At operation SA9, the comparing section 105 decides whether the n-th bit (in this case, 
the first bit "1") of the code C is the bit for which the decision made about the bit (in this case, 
"1") at operation SA8. In this case, the comparing section 105 sets "Yes" as a result of the 
decision. 

[0073] At operation SA10, the comparing section 105 increment n by 1. As a result, n 
becomes 2. At operation SA11, the comparing section 105 decides whether n is larger than 
nend, where nend is a total number of bits of the code C (refer to Fig. 4), and in the current 
example it is equal to 16. Because n is 2, the comparing section 105 sets "No" as a result of the 
decision made at operation SA11. 

[0074] At operation SA5, the block extracting section 102 extracts a pair of blocks 
corresponding to n = 2 (i.e., the block B, 12 and the block B r12 ) from the image data 11. Then, the 
block extracting section 102 outputs the density distributions of the block B, 12 and the block B r12 
as the block density data D to the averaging section 103. 

[0075] At operation SA6, the averaging section 103 obtains the left-side average density data 
D, 12 of the block B, 12 and the right-side average density data D r12 of the block B r12 from the block 
density data D by the average processing. 

[0076] At operation SA7, the averaging section 103 provides a control to store the left-side 
average density data D, 12 into the register 104, and store the right-side average density data D r12 
into the register 1 04 r . 

[0077] At operation SA8, the comparing section 105 obtains "0" that is the next bit 
(corresponding to n = 2) of the code C, and a difference between the left-side average density 
data D n2 and the right-side average density data D r12 stored in the register 104, and the register 
104 r respectively, and executes the bit decision based on the difference of densities (i.e., 
magnitude relation). 
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[0078] If the left-side average density data D M2 is less than the right-side average density 
data D r11l the comparing section 105 sets "0" as a result of the decision made for the pair of 
blocks based on the above magnitude relation. 

[0079] At operation SA9, the comparing section 105 decides whether the n-th bit (in this case, 
the second bit "0") of the code C is the bit for which the decision is made about the bit (in this 
case, "0") at operation SA8. In this case, the comparing section 105 sets "Yes" as a result of 
the decision. 

[0080] At operation SA10, the comparing section 105 increments n by 1. As a result, n 
becomes 3. At operation SA11, the comparing section 105 decides whether n (i.e., 3) is larger 
than nend (i.e., 16). In this case, the comparing section 105 sets "No" as a result of the 
decision made. Thereafter, the operation at operation SA5 and after is repeated until when the 
result of the decision made at operation SA11 becomes "Yes". 

[0081] When n is 16 at operation SA10 and also when the result of the decision made at 
operation SA11 is "No", at operation SA5, the block extracting section 102 extracts a pair of 
blocks corresponding to n = 16 (in this case, the block B, 28 and the block B r28 ) from the image 
data 11 . Then, the block extracting section 102 outputs the density distributions of the block B, 28 
and the block B r28 as the block density data D to the averaging section 103. 

[0082] At operation SA6, the averaging section 103 obtains the left-side average density data 
D, 28 ("125", see Fig. 3) corresponding to the block B, 28 and the right-side average density data 
Dr28 ("115", see Fig. 3) corresponding to the block B^s from the block density data D by the 
average processing. 

[0083] At operation SA7, the averaging section 103 provides a control to store the left-side 
average density data D| 28 ("125") into the register 104, and store the right-side average density 
data ("115") into the register 104 r . 

[0084] At operation SA8, the comparing section 105 obtains "0" that is the right bit 
(corresponding to n « 16) of the code C illustrated in Fig. 4, and a difference of densities (10) 
between the left-side average density data D, 28 ("125") and the right-side average density data 
Dr28 ("115") stored in the register 104, and the register 104 r respectively, and executes the bit 
decision based on the difference of densities (i.e., magnitude relation). 

[0085] In the current example, as the left-side average density data D, 28 ("125") is larger than 
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the right-side average density data ("115"), the comparing section 105 sets "1" as a result of 
the decision made for the pair of blocks based on the above magnitude relation. 

[0086] At operation SA9, the comparing section 105 decides whether the n-th bit (in this case, 
the 16-th bit "0") of the code C is the bit for which the decision is made about the bit (in this case, 
"1") at operation SA8. In this case, the comparing section 105 sets "No" as a result of the 
decision. 

[0087] At operation SA14, the comparing section 105 decides whether the difference of 
densities (10) obtained at operation SA8 is equal to or less than an upper threshold (for 
example, 100) set in advance, and in this case, sets "Yes" as a result of the decision made. 

[0088] At operation SA15, the encoding section 106 executes the density change processing 
to change the left-side average density data D, 28 and the right-side average density data D^s 
such that the result of the bit decision based on the magnitude relation between the left-side 
average density data D, 28 ("125") and the right-side average density data D^s ("115") becomes 
the same as the n-th bit (in this case, the 16-th bit "0") of the code C. 

[0089] In other words, the encoding section 106 reverses the magnitude relation between the 
left-side average density data D, 28 ("125") and the right-side average density data D^a ("115") 
such that the left-side average density data D| 28 becomes less than the right-side average 
density data D^, and changes the densities such that the result of the bit decision changes 
from "1" to "0". 

[0090] Specifically, the encoding section 106 obtains left-side average density data D'j after 
the change (corresponding to left-side average density data D', 28 after the change) from an 
expression (1) of (A) when D, < D r illustrated in Fig. 7. After this, the encoding section 106 
obtains right-side average density data D' r after the change (corresponding to right-side average 
density data D'^s after the change) from an expression (2) shown in Fig. 7. 

[0091] As a result, after the change of the densities, the left-side average density data D', 28 
becomes less than the right-side average density data D'^, and the result of the bit decision 
changes from "1" to '0". 

[0092] On the other hand, in order to obtain (B) D, > D r illustrated in Fig. 7, left-side average 
density data D', after the change (corresponding to left-side average density data D', xy after the 
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change) is obtained from an expression (3) shown in Fig. 7. After this, right-side average 
density data D* r after the change (corresponding to right-side average density data DVxy after the 
change) is obtained from an expression (4) shown in Fig. 7. 

[0093] As a result, after the change of the densities, the left-side average density data D', xy 
becomes equal to or larger than the right-side average density data D 1 ^, and the result of the bit 
decision changes from "0" to "1". 

[0094] When the result of the decision made at operation SA14 is "No", that is, when the 
difference of densities obtained at operation SA8 is larger than the upper threshold, the 
processing at operation SA10 is executed without executing the density change processing. 

[0095] The reason is explained below in detail. When the difference of densities in the pair of 
blocks is large, the execution of the density change processing apparently reveals the change. 
Therefore, in order to prevent the image quality from being degraded (unnatural image), the 
density change is not executed intentionally. 

[0096] At operation SA10, the comparing section 105 increments n by 1. As a result, n 
becomes 17. At operation SA11, the comparing section 105 decides whether n (= 17) is larger 
than nend (= 16). In this case, the comparing section 105 sets "Yes" as a result of the decision 
made. 

[0097] At operation SA12, the comparing section 105 decides whether the processing 
concerning the last pair of blocks (the blocks B, 168 and B r168 ) in the image data 11 ends, and, in 
this case, sets "No" as a result of the decision made. 

[0098] At operation SA16, the comparing section 105 resets n to 1 . At operation SA5, the 
block extracting section 102 extracts the next pair of blocks corresponding to n = 1 (in this case, 
the block B, 31 and the block B r31 ) from the image data 11. Then, the block extracting section 102 
outputs the density distributions of the block B, 31 and the block B r31 as the block density data D 
to the averaging section 103. 

[0099] Thereafter, the above operation is repeated until when the result of the decision made 
at operation SA12 becomes "Yes". 

[00100] When the result of the decision made at operation SA12 is "Yes", at operation SA13, 
the encoding section 106 generates and outputs the image coded data 13, based on the result of 
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the decision made at operation SA9 t the result of the decision made at operation SA14, and the 
density change processing at operation SA15. 

[00101] Specifically, when the result of the decision made at operation SA9 for the pair of 
blocks is "Yes" (when the result of the decision made at operation SA14 is "No"), the encoding 
section 106 maintains the magnitude relation between the left-side average density data D, and 
the right-side average density data D r (i.e., no change in the densities). On the other hand, 
based on the density change processing at operation SA15, the encoding section 106 
generates the image coded data 13 corresponding to the left-side average density data D\ and 
the right-side average density data D' r after the change, based on the density change 
processing at operation SA15. The decoder 200 described later decodes this image coded data 
13. 

[00102] The same code C (1010110101001010) is embedded by eight times in total into the 
areas to Aq in the image coded data 13 illustrated in Fig. 5. 

[00103] An operation example 2 of the encoder 100 is explained in detail below with reference 
to a flowchart in Fig. 8. In Fig. 8, operation SB10 and operation SB11 are added to the 
flowchart. 

[00104] Because operations SB1 to SB9 and SB12 to SB18 in Fig. 8 are same as the 
operations SA1 to SA16 in Fig. 6, their detailed explanation is omitted. 

[00105] At operation SB9 illustrated in Fig. 8, the comparing section 105 decides whether the 
n-th bit of the code C is the same as a result of the bit decision made at operation SB8, and, in 
this case, sets "Yes" as a result of the decision made. 

[00106] At operation SB10, the comparing section 105 decides whether the difference in the 
densities obtained at operation SB8 is less than a lower threshold (for example 10) set in 
advance. In this case, it is assumed that the result of the decision made is "Yes". 

[00107] When the difference of densities is less than the lower threshold, the magnitude 
relation is reversed and the precision becomes low. 

[00108] In order to avoid this problem, at operation SB 11 , the encoding section 106 adjusts 
the left-side average density data D, and the right-side average density data D r such that the 
difference of densities becomes equal to or higher than the lower threshold, and executes a 
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density difference expand processing to expand the difference of densities. 

[00109] When the result of the decision made at operation SB10 is "No", that is, when the 
difference in the densities is equal to or higher than the lower threshold, the processing at 
operation SB12 is executed. When the result of the decision made at operation SB16 is "No", 
the processing at operation SB12 is also executed. 

[00110] Fig. 9 is a block diagram of the decoder 200 according to the first embodiment. The 
decoder 200 decodes a code that is embedded in the image coded data 13 that is encoded by 
the encoder 100. 

[001 11] The decoder 200 includes an image cut-out section 201 that cuts out the effective 
image coded data 13 from the total when the surrounding of the image coded data 13 includes 
image data (for example, blank space). However, when only the image coded data 13 is input to 
the image cut-out section 201, the image cut-out section 201 does not cut out data. 

[00112] The decoder 200 includes a block dividing section 202 that divides the image coded 
data 13 output from the image cut-out section 201 into blocks of N rows x M columns (16 x 16, in 
the drawing) in the same manner as the block dividing section 101 of the encoder 100 divides 
the original image data 10, and outputs the result as image data divided into blocks. 

[00113] The decoder 200 includes a characteristic amount extracting section 208,and wherein 
characteristic amount section 208 includes a block extracting section 203, an averaging section 
204, a register 205I, and a register 205r. a block extracting section 203 that sequentially 
extracts pairs of blocks (two blocks) from the image data divided into blocks in the same manner 
as the block extracting section 102 of the encoder 100 extracts the pairs of blocks. The block 
extracting section 203 sequentially outputs density distributions of the pair of blocks (two blocks) 
as block density data. 

[00114] The decoder 200 includes an averaging section 204 that obtains left-side average 
density datacorresponding to one of the pair of blocks and right-side average density data 
corresponding to the other block from the block density data, and sequentially stores these data 
into a register 205, and a register 205 r following the bit shift of the code, in a similar manner to 
that of the averaging section 103 (refer to Fig. 1). 

[00115] A comparing section 206 compares a magnitude relation between the left-side 
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average density data and the right-side average density data stored in the register 205, and the 
register 205 r respectively, thereby making a bit decision. The comparing section 206 outputs a 
code group CG (candidate codes C, to C 8 : refer to Fig. 10) corresponding to the result of the bit 
decision (bit decided as "0" or "1" from the expression described above), to a decoding section 
207. 

[00116] Each of the candidate codes C t to C 8 has 16 bits, and is the result that each code (16 
bits) embedded into the areas A, to As of the image coded data 13 (refer to Fig. 5) is decoded. 
Each code is a candidate of a code C (refer to Fig. 9) as a result of the decoding by the 
decoder 200. 

[00117] In the candidate codes to C 8 , "2" denotes a bit for which a bit decision about "1" or 
"0" is uncertain. 

[00118] The decoding section 207 makes each bit (16 bits) firm based on a majority decision 
in a bit unit (a bit string in a vertical direction in the drawing) from the candidate codes C, to C 8 
corresponding to the result of the comparison by the comparing section 206, as illustrated in Fig. 
10. The decoding section 207 outputs this result as the code C of the result of decoding by the 
decoder 200. 

[001 19] Constituent elements of the decoder 200 are connected to each other via a control 
section (not shown). 

[00120] The operation of the decoder 200 is explained with reference to a flowchart illustrated 
in Fig. 11. 

[00121] At operation SC1 , the image coded data 13 (refer to Fig. 1 ) is input to the image cut- 
out section 201 . At operation SC2, n is initialized to 1 . n denotes a pointer of the bit of a code 
to be decoded. In this case, n = 1 corresponds to the leftmost bit of the code. 

[00122] At operation SC3, when the surrounding of the input image coded data 13 includes 
image data (for example, blank space), the image cut-out section 201 cuts out the effective 
image coded data 13 from the total. 

[00123] At operation SC4, the block dividing section 202 divides the image coded data 13 cut 
out by the image cut-out section 201 into 16x16 blocks based on the block divide processing, 
and outputs the result as the image data divided into blocks to the block extracting section 203, 
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in a similar manner to that of the block dividing section 101 (refer to Fig. 1). 

[00124] At operation SC5, the block extracting section 203 extracts a pair of blocks (two 
blocks) corresponding to n = 1 from the image data divided into blocks, and outputs the density 
distributions of these blocks as the block density data to the averaging section 204, in a similar 
manner to that of the block extracting section 102 (refer to Fig. 1). 

[00125] At operation SC6, the averaging section 204 obtains left-side average density data 
corresponding to one of the pair of blocks and right-side average density data corresponding to 
the other block from the block density data by the average processing, in a similar manner to 
that of the averaging section 103 (refer to Fig. 1). 

[00126] At operation SC7, the averaging section 204 provides a control to store the left-side 
average density data into a register 205, and store the right-side average density data into a 
register 205 r . 

[00127] At operation SC8, the comparing section 206 compares a magnitude relation between 
the left-side average density data and the right-side average density data stored in the register 
205, and the register 205 r respectively, thereby making a bit decision. The comparing section 
206 outputs the result of the bit decision (bit decided as "0" or "1" from the expression described 
above), to the decoding section 207. 

[00128] The comparing section 206 obtains a difference between the left-side average density 
data and the right-side average density data. When the difference of densities is larger than a 
certain upper threshold, the comparing section 206 sets the result of the bit decision to "2" 
(uncertain: refer to Fig. 10) by regarding that the bit decision result corresponding to the pair of 
blocks is not reliable. 

[00129] At operation SC9, the comparing section 206 increments n by 1. As a result, n 
becomes 2. At operation SC10, the comparing section 206 decides whether n is larger than 
nend (= 16), and in this case, sets "No" as a result of the decision made. 

[00130] Thereafter, the operation at operation SC5 and after is repeated until when the result 
of the decision made at operation SC10 becomes "Yes". 

[00131] When n becomes 17 at operation SC9, the result of the decision made at operation 
SC10 is set to "Yes". At this point of time, the comparing section 206 sets the candidate code C, 
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illustrated in Fig. 10 as a result of the bit decision. 

[00132] At operation SC11, the comparing section 206 decides whether the processing 
concerning the last pair of blocks (two blocks) in the image data divided into blocks ends, and, 
in this case, sets "No" as a result of the decision made. 

[00133] At operation SC14, the comparing section 206 sets n to 1 in order to reset n (= 17). At 
operation SC5, the block extracting section 203 extracts the next pair of blocks (two blocks) 
corresponding to n = 1 from the image data divided into blocks. Then, the block extracting 
section 203 outputs the density distributions of the blocks as the block density data to the 
averaging section 204. 

[00134] Thereafter, the above operation is repeated until when the result of the decision made 
at operation SC11 becomes "Yes". 

[00135] When the result of the decision made at operation SC11 becomes "Yes", at operation 
SC12, the decoding section 207 executes a majority decision processing. In other words, at this 
point of time, the candidate codes to C 8 illustrated in Fig. 10 are bit decision result. 

[00136] The decoding section 207 makes each bit (16 bits) firm based on a majority decision 
in a bit unit (a bit string in a vertical direction in the drawing) from the candidate codes C t to C 8 . 
For example, in the case of the leftmost bit of the candidate codes to C 8 , "0" is 2, "1" is 5, and 
"2" is 1 . Therefore, the leftmost bit of the code C is decided as "1" based on the majority 
decision. 

[00137] At operation SC13, upon reception of the result of the majority decision processing, 
the decoding section 207 outputs the code C* (refer to Fig. 10) as a result of the decoding by the 
decoder 200. The code C is the same as the code C (refer to Fig. 4). 

[00138] As explained above, according to the first embodiment, one bit (code) is related to 
each pair of blocks in a plurality of blocks (image data 11 : refer to Fig. 3) that are obtained by 
dividing the original image data 10 (refer to Fig. 2), based on a magnitude relation of the average 
density (characteristic amount), and the code C (plurality of codes) is embedded into a plurality 
of blocks. Thus, because it is not required to calculate the FFT the processing required to 
embed the code into the image data can be reduced. 

[00139] According to the first embodiment, as explained in the operation example 1 (refer to 
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Fig. 6), when the magnitude relation of the average density in the pair of blocks does not 
coincide with the bit (code) to be embedded, the average density of the pair of blocks is 
changed so as to reverse the magnitude relation. Therefore, an optional code can be 
embedded as desired. 

[00140] According to the first embodiment, as explained in the operation example 1 (refer to 
Fig. 6), when the difference of densities between the pair of blocks (i.e., difference between 
characteristic amounts) exceeds an upper threshold, the average density is not changed. 
Therefore, it is possible to prevent the image quality from being degraded following an 
excessive change of the average density. 

[00141] According to the first embodiment, as explained in the operation example 2 (refer to 
Fig. 8), when the magnitude relation of the average density (characteristic amount) coincides 
with the bit (code) to be embedded and also when the difference of densities between the pair 
of blocks (i.e., difference between characteristic amount) is less than a lower threshold, the 
average density is changed such that the difference becomes equal to or higher than the lower 
threshold. Therefore, when the decoder 200 decodes the code, a reduction in the precision 
such as a reversal of the magnitude relation can be prevented. 

[00142] According to the first embodiment, because the characteristic amount of the average 
density is employed, the characteristic amount can be calculated with lesser calculations and 
quickly. 

[00143] According to the first embodiment, the code C is embedded repeatedly (eight times) 
as illustrated in Fig. 5. Therefore, an uncertain code can be specified by the majority decision at 
the decoding time, and reliability can be increased. 

[00144] Thus, according to the first embodiment, it is possible to provide decoder can reduce 
the processing required to decode the code in the image data. 

[00145] Second Embodiment 

[00146] It is explained in the first embodiment that the encoder 100 performs embedding 

the code C (refer to Fig. 4) and the decoder 200 decodes the embedded code C. However, 
instead of using the code C, an error-correction-coding code is embedded using error correction 
coding (for example, BCH (Bose Chaudhuri Hocquenghem) code, or Reed Solomon code), and 
a decoder decodes the embedded error-correction-coding code. This configuration example is 
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[00147] An encoder 300 shown in Fig. 12 and a decoder 400 shown in Fig. 13 are examples 
of an image data processing apparatus according to the second embodiment The encoder 300 
embeds a code (binary) as separate data into an original image data, and generates image 
coded data, and the decoder 400 reads the code from the image coded data. 

[00148] Fig. 12 is a block diagram of the encoder 300. In this drawing, portions corresponding 
to those in Fig. 1 are designated with like reference numerals, and their explanation is omitted. 

[00149] In Fig. 12, an error correction code encoding section 301 is newly provided, and a 
comparing section 302 and an encoding section 303 are provided in place of the comparing 
section 105 and the encoding section 106 shown in Fig. 1. 

[00150] The error correction code encoding section 301 encodes a code Ca including x bits 
using error-correction-coding (for example, a BCH signal), and generates error-correction- 
coding CE. 

[00151] The code for error-correction-coding CE includes the code Ca (x bits), and a 
redundant bit (y bits) that is calculated from the code Ca and a predetermined calculation 
expression, and has (x + y) bits (for example, 15 bits). According to this error-correction-coding 
code CE, even when an error of three bits occurs, the original code Ca can be restored based 
on the error correction. 

[00152] The encoder 300 embeds the error-correction-coding code CE eight times, for 
example, into the original image data 10 (refer to Fig. 2), and generates image coded data 14. 
The encoder 300 is different from the encoder 100 in that the encoder 300 uses error- 
correction-coding code CE, while the encoder 100 uses the code C. 

[00153] The comparing section 302 compares the n-th bit of the error-correction-coding code 
CE with the result of a bit decision made from the magnitude relation between the left-side 
average density data D, and the right-side average density data D r stored in the register 104, 
and the register 104 r respectively (a bit decision is made as "0" or "1" from the relational 
expression described in the first embodiment: refer to Fig. 3). 

[00154] The encoding section 303 executes a processing to embed the error-correction- 
coding code CE into the image data 11 (the original image data 10) based on the result of the 
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comparison carried out by the comparing section 302. Specifically, when the result of the 
comparison carried out by the comparing section 302 indicates coincidence, the encoding 
section 303 maintains the magnitude relation between the left-side average density data D, and 
the right-side average density data D r . On the other hand, when the result of the comparison 
indicates non-coincidence, the encoding section 303 changes the left-side average density data 
D, and the right-side average density data D r (i.e., reverses the magnitude relation) so as to 
obtain the magnitude relation that expresses the bit of the error-correction-coding CE, generates 
the image coded data 14, and outputs this data. 

[00155] This image coded data 14 has the same configuration as the image coded data 13. 
Therefore, the same error-correction-coding code CE (15 (x + y) bits) is embedded by eight 
times in total into the image coded data 14. 

[00156] Constituent elements of the encoder 300 are connected to each other via a control 
section not illustrated. 

[00157] The operation of the encoder 300 is similar to that of the encoder 100 except that the 
error-correction-coding code CE is used, and therefore, the explanation is omitted. 

[001 58] Fig. 1 3 is a block diagram of the decoder 400. The decoder 400 decodes the 
embedded error-correction-coding code CE (code Ca) from the image coded data 14 that is 
encoded by the encoder 300. 

[00159] In Fig. 13, portions corresponding to those in Fig. 9 are designated with like reference 
numerals, and their explanation is omitted. In Fig. 13, a comparing section 401 and a decoding 
section 402 are provided in place of the comparing section 206 and the decoding section 207 
shown in Fig. 9. 

[00160] The comparing section 401 compares a magnitude relation between the left-side 
average density data and the right-side average density data stored in the register 205, and the 
register 205 r respectively, thereby making a bit decision, in a similar manner to that of the 
comparing section 206 (refer to Fig. 9). The comparing section 401 outputs a candidate error- 
correction-coding code group CEG (candidate error-correction-coding codes CE, to CE 8 : refer 
to Fig. 15) corresponding to the result of the bit decision (bit decided as "0" or "1" from the 
expression explained in the first embodiment), to a decoding section 402. 

[00161] Each of the candidate error-correction-coding codes CE! to CE 8 has 15 (x + y) bits, 
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and is the result that eight error-correction-coding codes (15 bits) embedded into the image 
coded data 14 are decoded. Each code is a candidate of an error-correction-coding code for CE' 
(refer to Fig. 15). 

[00162] In the candidate error-correction-coding codes CE, to CE 8 , "2" denotes a bit for which 
a bit decision about "1" or "0" is uncertain. 

[00163] The decoding section 402 makes each bit (15 bits in total) firm based on a majority 
decision in a bit unit (a bit string in a vertical direction in the drawing) from the candidate error- 
correction-coding codes CE, to CE Q corresponding to the result of the comparison by the 
comparing section 401, as illustrated in Fig. 15. The decoding section 402 outputs this result as 
the error-correction-coding code CE'. 

[00164] Strictly speaking, the error-correction-coding code CE 1 has a risk of including an error 
bit. Therefore, in the second embodiment, the decoding section 402 executes a supplement 
processing to replace the bit of "2" (uncertain) in the candidate error-correction-coding codes 
CE! to CE 8 (i.e., the candidate error-correction-coding code group CEG) with a corresponding 
bit in the error-correction-coding code CE', and obtains candidate error-correction-coding codes 
CE\ to CE' 8 (a candidate error-correction-coding code group CEG'). 

[00165] The decoding section 402 executes an error correctiondecode processing (for 
example, a decode processing based on the BCH code) for each of the candidate error- 
correction-coding codes CE\ to CE' 8 , and obtains a code (corresponding to the code Ca 
illustrated in Fig. 12, for example) and number of errors. The number of errors is number of 
error bits in each of the error-correction-coding codes CE\ to CEV 

[00166] The decoding section 402 outputs a code corresponding to a minimum number of 
errors among codes obtained by the error correction decode processing, as a code Ca*. This 
code Ca' is the result of decoding by the decoder 400. 

[00167] Constituent elements of the decoder 400 are connected to each other via a control 
section not illustrated. 

[00168] Next, the operation of the decoder 400 illustrated in Fig. 13 is explained with reference 
to a flowchart illustrated in Fig. 14. 

[00169] In the drawing, at operation SD1, the image coded data 14 (refer to Fig. 12 and Fig. 
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13) is input to the image cut-out section 201 . At operation SD2, n is initialized to 1 . This n 
denotes a pointer of the bit of a code to be decoded. In this case, n = 1 corresponds to the 
leftmost bit of the code. 

[00170] At operation SD3, when the surrounding of the input image coded data 14 includes 
image data (for example, blank space), the image cut-out section 201 cuts out the effective 
image coded data 14 from the total. 

[00171] At operation SD4, the block dividing section 202 divides the image coded data 14 cut 
out by the image cut-out section 201 into MxN blocks based on the block divide processing, 
and outputs the result as the image data divided into blocks to the block extracting section 203. 

[00172] At operation SD5, the block extracting section 203 extracts a pair of blocks (two 
blocks) corresponding to n = 1 from the image data divided into blocks, and outputs the density 
distributions of these blocks as the block density data to the averaging section 204. 

[00173] At operation SD6, the averaging section 204 obtains left-side average density data 
corresponding to one of the blocks and right-side average density data corresponding to the 
other block from the block density data by the average processing. 

[00174] At operation SD7, the averaging section 204 stores the left-side average density data 
into a register 205, and stores the right-side average density data into a register 205 r 
respectively. 

[00175] At operation SD8, the comparing section 401 compares a magnitude relation between 
the left-side average density data and the right-side average density data stored in the register 
205, and the register 205 r respectively, thereby making a bit decision. The comparing section 
401 outputs the result of the bit decision (bit decided as "0" or "1" from the expression described 
above), to the decoding section 402. 

[00176] The comparing section 401 obtains a difference between the left-side average density 
data and the right-side average density data. When the difference of densities is larger than the 
upper threshold explained at operation SA14 (refer to Fig. 6), the comparing section 401 sets 
the result of the bit decision to "2" (uncertain: refer to Fig. 15) by regarding that the bit decision 
result corresponding to the pair of blocks is not reliable. 

[00177] At operation SD9, the comparing section 401 increments n by 1. As a result, n 
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becomes 2. At operation SD10, the comparing section 401 decides whether n is larger than 
nend (= 15), and in this case, sets "No" as a result of the decision made, in a similar manner to 
that at operation SC10 (refer to Fig. 11). 

[00178] Thereafter, the operation at operation SD5 and after is repeated until when the result 
of the decision made at operation SD10 becomes "Yes". 

[00179] When n becomes 17 at operation SD9, the result of the decision made at operation 
SD10 is set to "Yes". At this point of time, the comparing section 401 sets the candidate code 
for error-correction-coding CE t illustrated in Fig. 15 as a result of the bit decision. 

[00180] At operation SD11, the comparing section 401 decides whether the processing 
concerning the last pair of blocks (two blocks) in the image data divided into blocks ends, and, 
in this case, sets "No" as a result of the decision made. 

[00181] At operation SD16, the comparing section 401 sets n to 1 in order to reset n (= 16). At 
operation SD5, the block extracting section 203 extracts the next pair of blocks (two blocks) 
corresponding to n = 1 from the image data divided into blocks. Then, the block extracting 
section 203 outputs the density distributions of the blocks as the block density data to the 
averaging section 204. 

[00182] Thereafter, the above operation is repeated until when the result of the decision made 
at operation SD11 becomes "Yes". 

[00183] When the result of the decision made at operation SD11 becomes "Yes", at operation 
SD12, the decoding section 402 executes a majority decision processing, in a similar manner to 
that at operation SC12 (refer to Fig. 11). In other words, at this point of time, the candidate 
error-correction-coding codes CE 1 to CE 8 illustrated in Fig. 15 are the result of the bit decision. 

[00184] The decoding section 402 makes each bit (15 bits in total) firm based on a majority 
decision in a bit unit (a bit string in a vertical direction in the drawing) from the candidate error- 
correction-coding codes CEi to CE 8 . As a result, the error-correction-coding code CE* is 
generated. 

[00185] For example, in the case of the leftmost bit of the candidate error-correction-coding 
code CE 1 to CE 8 , "0" is 2, "1" is 5, and "2" is 1. Therefore, the leftmost bit of the error- 
correction-coding code CE' is decided as "1" based on the majority decision. 
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[00186] At operation SD13, the decoding section 402 executes a supplement processing to 
replace the bit of "2" (uncertain) in the candidate error-correction-coding codes CE^ to CE 8 (i.e., 
the candidate error-correction-coding code group CEG) with a corresponding bit in the error- 
correction-coding code CE\ and obtains the candidate error-correction-coding code group 
CEG 1 (i.e., the candidate error-correction-coding codes CE\ to CE* 8 ). 

[00187] At operation SD14, the decoding section 402 executes the error correction decode 
processing (for example, a decode processing based on the BCH code) for each of the 
candidate error-correction-coding codes CE^ to CEg, and obtains a code (corresponding to the 
code Ca illustrated in Fig. 12) and number of errors. 

[00188] At operation SD15, the decoding section 402 outputs a code corresponding to a 
minimum number of errors among codes obtained by the error correction decode processing, as 
the code Ca*. 

[00189] As explained above, according to the second embodiment, the error-correction- 
coding code CE is embedded into a plurality of blocks as explained with reference to Fig. 12. 
Therefore, the decoder 400 and the like can correct errors, and can increase reliability. 

[00190] Third Embodiment 

[00191] In the first and the second embodiments, the configuration example of encoding and 
decoding using the average density of the total block (for example, the block B, 18 ) as illustrated 
in Fig. 3 is explained. It is also possible to have a configuration that uses the average density of 
only some portion (for example, the center portion) of the blocks. This configuration example is 
explained below as a third embodiment of the present invention. 

[00192] Fig. 16 is to explain the third embodiment. In this drawing, a block B corresponds to 
the block (for example, the block B, 18 illustrated in Fig. 3) in the first and the second 
embodiments, and has a size of t x t pixels. In the third embodiment, encoding and decoding 
are carried out using the average density of a center portion Ba ((t/2) x (t/2) pixel size) as one 
portion of the block B. 

[00193] As explained above, according to the third embodiment, the processing quantity 
concerning the density change processing can be reduced from that when the average density 
of the total block is used. 
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[00195] When the first to the third embodiments described above are applied to a color image, 
the following two methods may be employed. One method is to embed a code into a gray scale 
image (a monochromatic image) that is obtained by transforming a color image into brightness. 
The other method is to embed a code into any one component (for example, a yellow color 
component) out of color components (a cyan component, a magenta component, and a yellow 
component) of three primary colors (cyan, magenta, and yellow) in a color image. 

[00196] The latter method has an advantage over the former method in that a change in the 
density is not easily discriminated by human eyes (refer to Fig. 18). Fig. 18 is a graph that 
expresses a relation between a density change quantity and MOS (Mean Opinion Score) 
according to the fourth embodiment. 

[00197] This graph is the result of evaluation according to a subjective evaluation method that 
is prescribed in the International Commission on Illumination (ITU-T) known as an image 
evaluation method. According to the subjective evaluation method, when it is not possible to 
visually discriminate between an original image and an image obtained by changing the image 
by only a density change, five points are scored for the MOS value. When a difference between 
the two images becomes larger, a lower score is evaluated for the MOS value. 

[00198] In the graph, "yellow" is the result of evaluation concerning an image of the yellow 
component. The "brightness" is the result of evaluation concerning an image of gray scale. As 
is clear from this graph, the yellow component ("yellow") has a higher MOS value than that of 
the gray scale ("brightness") even when the density change quantity increases. Therefore, 
according to the latter method of changing the density in the yellow component, a change 
cannot be easily discriminated by human eyes. 

[00199] A configuration example of embedding a code into a color component (in this case, 
the yellow component) is explained as a fourth embodiment according to the present invention. 

[00200] Fig. 17 is a block diagram of an encoder 500 according to the fourth embodiment. In 
this drawing, portions corresponding to those in Fig. 12 are designated with like reference 
numerals, and their explanation is omitted. 

[00201] In Fig. 17, a yellow component cut-out section 501 and a yellow component 
integration section 502 are newly provided. The yellow component cut-out section 501 cuts out 
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the yellow component from block density data D, and outputs this component as yellow block 
density data DE to the averaging section 103. 

[00202] The yellow component cut-out section 501 obtains left-side average density data DE, 
corresponding to one block and right-side average density data DE r corresponding to the other 
block from the yellow block density data DE, and stores these data into the register 104, and the 
register 104 r respectively. 

[00203] The yellow component cut-out section 501 also cuts out the cyan component and the 
magenta component from the block density data D, and outputs these components as 
cyan/magenta block density data DCM to the yellow component integration section 502. 

[00204] In the fourth embodiment, a processing is executed to the yellow block density data 
DE, and the density of the yellow component is changed. The encoding section 303 outputs 
yellow image coded data IE4 corresponding to the yellow component. The yellow component 
integration section 502 integrates the yellow image coded data IE4 and the cyan/magenta block 
density data DCM, and outputs the result as image coded data 15. 

[00205] As explained above, according to the fourth embodiment, the yellow component cut- 
out section 501 cuts out the yellow component, and embeds into a plurality of blocks of the 
yellow component. Therefore, by utilizing the characteristic amount that yellow is not distinctive, 
the data decision capacity can be maintained without degrading the image quality. 

[00206] Fifth Embodiment 

[00207] A fifth embodiment of the present invention relates to how the image cut-out section 
201 illustrated in Fig. 9 cuts-out the image. As illustrated in Fig. 19, the encoder 100 (refer to 
Fig. 1) may add yellow marks ME, to ME 4 at four corners of the image coded data 13 to 
distinguish between the cut-out portion and a blank portion P. This configuration example is 
explained below as the fifth embodiment 

[00208] In Fig. 19, the yellow marks ME! to ME 4 are yellow fine dots, and are not distinctive as 
explained with reference to Fig. 18. 

[00209] Next, how the image cut-out section 201 illustrated in Fig. 9 cuts the image is 
explained. When the blank portion P and the image coded data 13 (the yellow marks ME! to 
ME 4 ) illustrated in Fig. 19 are input to the image cut-out section 201, a four-corner search 
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processing illustrated in Fig. 21 is executed. 

[00210] In this four-corner search processing, the four corners of the image coded data 13 (the 
yellow marks ME, to ME 4 ) illustrated in Fig. 19 are searched. In the following explanation, 
number of pixels of the blank portion P (white) is assumed as 255, and number of pixels of black 
(yellow) is assumed as 0. 

[00211] Specifically, at operation SE1 illustrated in Fig. 20, the image cut-out section 201 
searches a minimum pixel value (for example, 250) in the blank portion P (white) that is the 
surrounding portion of the image coded data 13. At operation SE2, the image cut-out section 
201 multiplies a safety ratio (0.9) to the minimum pixel value (250), thereby setting a threshold 
(225). 

[00212] At operation SE3, the image cut-out section 201 searches a position of pixels equal to 
or smaller than the threshold (255) by moving a search line L of an inclination angle 45 degrees 
from a corner of the blank portion P (the left upper corner in Fig. 21) to an X direction, as 
. illustrated in Fig. 21. 

[00213] When the search line L reaches the yellow mark ME^ the image cut-out section 201 
firms the position of the yellow mark ME, as one of the four corners of the image coded data 13, 
as the pixel value (= 0) of the yellow mark ME^ is smaller than the threshold. 

[00214] At operation SE4, the image cut-out section 201 decides whether the four corners of 
the image coded data 13 are searched, and, in this case, sets "No" as a result of the decision 
made. Thereafter, the processing at operation SE3 is executed for the other three corners. 
When the four corners (the yellow marks ME! to ME 4 ) illustrated in Fig. 19 are searched, the 
image cut-out section 201 sets "Yes" as a result of the decision made at operation SE4. 

[00215] Next, the image cut-out section 201 cuts out the image coded data 13 from the total 
image (i.e., the blank portion P and the image coded data 13) illustrated in Fig. 19 according to a 
known affine transformation or the like using the position coordinates of the yellow marks ME, to 
ME 4 . 

[00216] As explained above, according to the fifth embodiment, the yellow marks ME, to ME 4 
for cut-out are given to the image coded data 13 as the embedded result as illustrated in Fig. 19. 
Therefore, the image cut-out at the decoding time can be executed easily. 
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[00217] While the configurations according to the first to the fifth embodiments of the present 
invention are explained in detail with reference to the drawings, detailed configuration examples 
are not limited to the first to the fifth embodiments. In the present invention, any design 
alteration within a scope not departing from the gist of the invention is included. 

[00218] For example, in the first to the fifth embodiments, a computer program that achieves 
the functions of the encoder 100, the decoder 200, the encoder 300, the decoder 400, or the 
encoder 500 may be recorded onto a computer-readable recording medium 700 illustrated in 
Fig. 22. A computer 600 illustrated in Fig. 22 reads the computer program recorded on the 
recording medium 700, and executes the computer program, thereby achieving the functions. 

[00219] The computer illustrated in this drawing includes a CPU (Central Processing Unit) 610 
that achieves the computer program, an input unit 620 including a keyboard and a mouse, a 
ROM (Read Only Memory) 630 that stores various data, a RAM (Random Access Memory) 640 
that stores operation parameters, a reading unit 650 that reads the computer program from the 
recording medium 700, and an output unit 660 including a display and a printer. 

[00220] The CPU 610 reads the computer program that is recorded on the recording medium 
700 via the reading unit 650, and executes the computer program, thereby achieving the 
functions. The recording medium 700 includes an optical disk, a flexible disk, a hard disk, etc. 

[00221] The characteristic amount of the image is not limited to the average density. It is also 
possible to use other characteristic amount that are obtained from granularity, chroma, density 
barycenter, and variance. In this case, as the characteristic amount is granularity, chroma, 
density barycenter, or variance, the characteristic amount is not distinctive, which can reduce 
the influence to the image quality. 

[00222] In the first to the fifth embodiments, the characteristic amount may be changed to 
other characteristic amount based on a predetermined conversion rule. 

[00223] Effects due to the Invention 

[00224] As explained above, according to the present invention, one code is related to each 
pair of blocks in a plurality of blocks as a result of dividing image data, based on a magnitude 
relation of characteristic amount, and a plurality of codes are embedded into a plurality of blocks. 
Therefore, there is an effect that the conventional FFT is not necessary, and that the processing 
required to embed the code into the image data can be reduced. 
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[00225] According to the present invention, when the magnitude relation of characteristic 
amount between the pair of blocks does not coincide with the code to be embedded, the 
characteristic amount of the pair of blocks are changed to reverse the magnitude relation. 
Therefore, there is an effect that a desired code can be freely embedded. 

[00226] According to the present invention, when a difference of characteristic amount 
between a pair of blocks exceeds an upper threshold, the characteristic amount are not 
changed. Therefore, there is an effect that it is possible to prevent the image quality from being 
degraded following an excessive change of the average density. 

[00227] According to the present invention, when the magnitude relation of characteristic 
amount coincides with the code to be embedded and also when the difference of densities 
between the pair of blocks is less than a lower threshold, the characteristic amount are changed 
such that the difference becomes equal to or higher than the lower threshold. Therefore, there 
is an effect that when the code is decoded, a reduction in the precision such as a reversal of the 
magnitude relation can be prevented. 

[00228] According to the present invention, as a plurality of codes for error-correction-coding 
are embedded into a plurality of blocks, there is an effect that the decoding side can correct an 
error, and reliability can be increased. 

[00229] According to the present invention, as each characteristic amount is extracted from a 
portion of each block, there is an effect that the processing quantity can be reduced as 
compared with when the characteristic amount of a total block is used. 

[00230] According to the present invention, a yellow component is cut out from a plurality of 
blocks, and embedding is executed into a plurality of blocks of the yellow component. Therefore, 
there is an effect that by utilizing the characteristic amount that yellow is not distinctive, the data 
decision capacity can be maintained without degrading the image quality. 

[00231] According to the present invention, there is an effect that the processing required to 
decode a code of the image data can be reduced. 

[00232] The system also includes permanent or removable storage, such as magnetic and 
optical discs, RAM, ROM, etc. on which the process and data structures of the present invention 
can be stored and distributed. The processes can also be distributed via, for example, 
downloading over a network such as the Internet. 
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[00233] The many features and advantages of the invention are apparent from the detailed 
specification and, thus, it is intended by the appended claims to cover all such features and 
advantages of the invention that fall within the true spirit and scope of the invention. Further, 
since numerous modifications and changes will readily occur to those skilled in the art, it is not 
desired to limit the invention to the exact construction and operation illustrated and described, 
and accordingly all suitable modifications and equivalents may be resorted to, falling within the 
scope of the invention. 
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